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Abstract 

The randomized load balancing model (also called supermarket model) is now being 
applied to the study of load balancing in data centers and multi-core servers systems. 
It is very interesting to analyze the general service times in the supermarket model, 
and specifically understand influence of the heavy-tailed service times on the doubly 
exponential solution. Since the supermarket model is a complex queueing system, the 
general service times make its analysis more challenging than the exponential or PH 
service case. Up to now, it still is an open problem whether or how the heavy-tailed 
service times can disrupt the doubly exponential structure of the fixed point in the 
supermarket model. 

In this paper, we provide a novel and simple approach to study the supermarket 
model with general service times. This approach is based on the supplementary vari- 
able method used in analyzing stochastic models extensively. We organize an infinite- 
size system of integral-differential equations by means of the density dependent jump 
Markov process, and obtain a close-form solution: doubly exponential structure, for 
the fixed point satisfying the system of nonlinear equations, which is always a key in 
the study of supermarket models. The fixed point is decomposited into two groups of 
information under a product form: the arrival information and the service informa- 
tion. Based on this, we indicate two important observations: the fixed point for the 
supermarket model is different from the tail of stationary queue length distribution for 
the ordinary M/G/l queue, and the doubly exponential solution to the fixed point can 
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extensively exist even if the service time distribution is heavy-tailed. Furthermore, we 
analyze the exponential convergence of the current location of the supermarket model 
to its fixed point, and study the Lipschitz condition in the Kurtz Theorem under gen- 
eral service times. Based on these analysis, one can gain a new understanding how 
workload probing can help in load balancing jobs with general service times such as 
heavy-tailed service. 

Keywords: Randomized load balancing, supermarket model, density dependent 
jump Markov process, fixed point, doubly exponential solution, heavy-tailed distri- 
bution, exponential convergence, Lipschitz condition. 

1 Introduction 

Randomized load balancing, where a job is assigned to a server from a small subset of 
randomly chosen servers, is very simple to implement, and can surprisingly deliver bet- 
ter performance (for example reducing collisions, waiting times, backlogs) in a number 
of applications, such as, data center, hash tables, distributed memory machines, path 
selection in networks, and task assignment at web servers. One useful model that has 
been extensively used to study the randomized load balancing schemes is the supermarket 
model. In the supermarket model, a key result by Vvedenskaya, Dobrushin and Karpele- 
vich |3T] indicated that when each Poisson arriving job is assigned to the shortest one 
of d > 2 randomly chosen queues with exponential service times, the equilibrium queue 

length can decay doubly exponentially in the limit as the population number n — > oo, and 

d k -i 

the stationary fraction of queues with at least k customers is p d -! , which is a substan- 
tially exponential improvement over the case for d = 1, where the tail of stationary queue 
length distribution in the corresponding M/M/l queue is p . 

The distributed load balancing strategies, in which individual job decisions are based 
on information on a limited number of other processors, have been studied analytically 
by Eager, Lazokwska and Zahorjan EJ [7] and through trace-driven simulations by 
Zhou [33]. Based on this, the supermarket model is developed by queueing theory and 
Markov processes. Most of recent research applied the density dependent jump Markov 
processes to deal with a simple supermarket model with Poisson arrival processes and 
exponential service times, a key result of which illustrates that there exists a unique fixed 
point which is decreasing doubly exponentially. That approach used in the literature relies 
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on determining the behavior of the supermarket model as its size grows to infinity, and 
its behavior is naturally described as a system of differential equations, which leads to a 
closed form solution: doubly exponential structure, of the fixed point. Readers may refer 
to, such as, analyzing a basic and simple supermarket model by Azar, Broder, Karlin and 
Upfal [2], Vvedenskaya, Dobrushin and Karpelevich [31], Mitzenmacher [19\ 120] . 

Certain generalization of the supermarket model have been explored, for example, sim- 
ple variations by Mitzenmacher and Vocking [27J , Mitzenmacher [21[ [22j [25] , Vocking [30^ , 
Mitzenmacher, Richa, and Sitaraman |26] and Vvedenskaya and Suhov [32]; and analyzing 
load information by Mirchandaney, Towsley, and Stankovic [28] , Dahlin [3] , Mitzenmacher 
|24[ 126] . Furthermore, Martin and Suhov |18j . Martin |17j . Suhov and Vvedenskaya [29J 
studied the supermarket mall model by means of the fast Jackson network, where each 
node in a Jackson network is replaced by N parallel servers, and a job joins the shortest 
of d randomly chosen queues at the node to which it is directed. Luczak and McDiamid 
|15[ PT6] studied the maximum queue length of the original supermarket model with expo- 
nential service times when the service speed scales linearly with the number of jobs in the 
queue. Li, Lui and Wang |11[ PT2] discussed the supermarket model with PH service times 
and the supermarket model with Markovian arrival processes, respectively. Readers may 
refer to an excellent overview by Mitzenmacher, Richa, and Sitaraman [26j . 

This paper is interested in analyzing the supermarket model with general service times, 
which is an open problem for determining whether or how the heavy-tailed service times 
can disrupt the doubly exponential structure of the fixed point. On the other hand, 
note that the supermarket model is a complex queueing system and has much different 
characteristics from the ordinary queueing systems, thus the general service times make 
its analysis more challenging than the exponential or PH service case. Up to now, there 
has not been an effective method to be able to deal with the supermarket model with 
general service times. 

The main contributions of the paper are threefold. The first one is to provide a novel 
and simple approach to study the supermarket model with general service times. This 
approach is based on the supplementary variable method but is described as a new integral- 
differential structure for expressing and computing the fraction of queues efficiently. Using 
the new approach, we setup an infinite-size system of integral-differential equations, which 
makes applications of the density dependent jump Markov processes to be able to deal 
with the general distributions, such as general service times, involved in the supermarket 



3 



model. The second one is to obtain a close-form solution: doubly exponential structure, 
for the fixed point satisfying the system of nonlinear equations, which is always a key 
in the study of supermarket models. Furthermore, this paper analyzes the exponential 
convergence of the current location of the supermarket model to its fixed point, and studies 
the Lipschitz condition in the Kurtz Theorem under general service times. Also, this paper 
provides numerical examples to illustrate the effectiveness of our approach in analyzing the 
randomized load balancing schemes with the non-exponential service requirements. The 
third one is to obtain that the fixed point is decomposited into two groups of information 
under a product form: the arrival information and the service information. Based on this, 
we indicate three important observations: 

(a) The fixed point for the supermarket model is different from the tail of stationary 
queue length distribution for the ordinary M/G/l queue, because the fixed point is 
light-tailed but the stationary queue length is heavy-tail if the service times are 
heavy-tailed. Note that such a difference is illustrated in this paper for the first 
time, while it can not be observed in the literature for the supermarket model with 
Poisson arrivals and exponential service times, e.g., see Mitzenmacher, Richa, and 
Sitaraman 261. 



(b) The doubly exponential solution to the fixed point can extensively exist even 
if the service time distribution is heavy-tailed. This is an answer of the above open 
problem to illustrate the role played by the heavy-tailed service time distribution in 
the doubly exponential solution to the fixed point. 

(c) The doubly exponential solution to the fixed point is not unique for a more 
general supermarket model. Note that we give three different doubly exponential 
solutions in the supermarket model with Poisson arrivals and PH service times, 
thus it is very interesting to provide all the doubly exponential solutions for a more 
general supermarket model. 

Based on this, one can gain the new and important understanding how the workload 
probing can help in load balancing jobs with general service times such as heavy-tailed 
service. 

The remainder of this paper is organized as follows. In Section 2, we first describe 
a supermarket model with general service times, which is always useful in the study 
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of randomized load balancing schemes. Then the supermarket model is expressed as a 
systems of integral-differential equations in terms of the density dependent jump Markov 
processes. In Section 3, we first introduce a fixed point of the system of integral-differential 
equations, and set up a system of nonlinear equations satisfied by the fixed point. Then 
we provide a close-form solution: doubly exponential structure, to the system of nonlinear 
equations. In Section 4, we provide a necessary discussion on the key parameter 9 used 
in the doubly exponential structure, and indicate that the doubly exponential solution to 
the fixed point extensively exists even if the service time distribution is heavy-tailed. In 
Section 5, we give three methods to analyze the supermarket model with Poisson arrivals 
and PH service times, and provide three different ways to determine the key parameter 9 
and compute the doubly exponential solution to the fixed point. We show that the doubly 
exponential solution to the fixed point is not unique for a more general supermarket. In 
Section 6, we study the exponential convergence of the current location of the supermarket 
model to its fixed point. Not only does the exponential convergence indicates the existence 
of the fixed point, but it also explains such a convergent process is very fast. In Section 
7, we apply the Kurtz Theorem to study the supermarket model with the general service 
times, and analyze the Lipschitz condition with respect to general service times. Some 
concluding remarks are given in Section 8. 



2 Supermarket Model 

In this section, we first describe a supermarket model with general service times. Then we 
provide a novel and simple approach to setup an infinite-size system of integral-differential 
equations based on the density dependent jump Markov processes. Note that this ap- 
proach is based on the supplementary variable method but is described as a new integral- 
differential structure so that the corresponding boundary conditions are written in a dif- 
ferent version. 

Let us formally describe the supermarket model, which is abstracted as a multi-server 
multi-queue stochastic system. Customers arrive at a queueing system of n > 1 servers as 
a Poisson process with an average arrival rate nX for A > 0. The service time Xk of the 
kth customer is general with the distribution function 

G ( x ) = p {Xk < x} = 1 - exp j- n(y)dy^, 
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where all the random variables Xk for k > 1 are i.i.d. with the mean E [xk] = I// 2 - Each 
arriving customer chooses d > 1 servers independently and uniformly at random from 
these n servers, and waits for service at the server which currently contains the fewest 
number of customers. If there is a tie, servers with the fewest number of customers will 
be chosen randomly. All customers in any service center will be served in the First-Come- 
First-Served (FCFS) manner. Figure 1 simply shows such a supermarket model. 



Poisson Arrival 

nA, ► < < ^~" 

each customer 
probes d servers 



/ d 



® 
o 
o 



© 



Figure 1: working structure of the supermarket model 

In the study of supermarket models, it is necessary for us to study general service 
time distributions, for example, heavy-tailed distributions. Not only because the general 
distribution makes analysis of the supermarket models more difficult and challenging than 
those in the literature for the exponential or PH service case, but it also allows us to 
model more realistic systems and understand their performance implication under the 
randomized load balancing strategy. As indicated in [8] , the process times of many parallel 
jobs, in particular, jobs to data centers, tend to be non-exponential. Unless we state 
otherwise, we assume that all the random variables defined above are independent, and 
that the system is operating under the condition: p = X/p < 1. 

Lemma 1 The supermarket model with general service times is stable if p = X/p < 1. 

Proof: Let Qo(t) an d Qs(t) be the queue lengths of the ordinary M/G/l queue 
and of an arbitrary server in the supermarket model at time i, respectively. Note that in 
the supermarket model, each customer chooses d servers independently and uniformily at 
random, and the queue length of the entering server is currently shorten, it is easy to see 
that for each t > 0, 

< Q s (t) < Qo (t) ■ (1) 

St 



Since the ordinary M/G/l queue is stable if p = X/fj, < 1, it follows from ([I]) that the 
supermarket model with general service times is stable ifp = A//i<l. This completes 
the proof. ■ 
For k > 1, we define (t, x)dx as the number of queues with at least k customers and 
the residual service time of each server be in the interval [x,x+dx) at time t > 0. Clearly, 
< rifc (i, x) < n for x > and 1 < A; < n. Let 

_ n fc (t,x) 
n 

which is the density function of the fraction of queues with at least k customers and the 
residual service time of each server be x. We write 

Sk (t, x) = lim Sfc n (t, x) , for k > 1. 

n— >oo ' 

We define no, n (i) as the number of queues with at least customers at time t > 0. Clearly, 
n o,n (£) = n - Let 

,.s n , n (t) 

S0,n {t) = ■ 

n 

Then so, n (t) = 1 for alH > and 

So (t) = lim s , n (t) = 1. 

n— >oo 

Let V (t) be the fraction of queues with zero customer at time t. Then 

r+oo 

S (t) = V(t)+ I Si (t, x) dx. 

Thus we have 



o 



S (t, x) = (S (t) , Si (t, x) , S 2 (t, x) , . . .) . 

The following proposition shows that the sequence {S& (t,x)} is monotone increasing 
for k > 1, while its proof is easily by means of the definition of S& (t, x) for k > 1. 

Proposition 1 For 1 < k < I 

Si(t,x) < S k (t,x) < S (t) = 1 

and 

oo p+oo 

Si (t, x) dx < / Sfc (t, x) dx < So (t) = 1. 
o Vo 
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Now, we setup a system of integral-differential equations by means of the density 
dependent jump Markov process. To that end, we provide an example with k > 2 to 
indicate how to derive the system of integral-differential equations. 

Consider the supermarket model with n queues, and determine the expected change in 
the number of servers with at least k customers and the residual service time of each server 
be x over a small time period of length dt. The probability that a customer arriving during 
this time period is nXdt, and the probability that an arriving customer joins a queue of 
size A; — 1 is given by Jq + °° sf_ 1 n (t, x)dx — f + °° n (t, x)dx. Thus, the probability that 
during this time period, any arriving customer joins a queue of size A; — 1 is given by 



nXdt 



r+oo /H 
/ 4-l,n(.t^)dx- 

Jo Jo 



s k,n (*> x ) & x 



Similarly, the probability that a customer leaves a server of size k is given by 



ndt ■ 



H(x)s kn (t,x)dx 



o 



Therefore we can obtain 
d J +o ° n k (t, x) dx 



df 

which leads to 

d Jo +0 ° s k,n (t, x) dx 
dt 



-nX 



+ n 



UO 



fi(x) S k , n (t,x)dx 



H(x) s k+ i, n (t,x)dx 



c,n (*> x ) 



H (x) s fc+ i,„ (t,x) dx 



s k-l,n (*> x ) dx 



+oo 



+ 



+oo 



H{x) Sfc,n (t,x) dx 



s fc,n (*, x ) dx 



IX (x) S k+ltn (t,x) dx 



(2) 



Taking n — > oo in the both sides of ([2]), we have 
dj + °°S k (t)dx r r+™ 



dt 



--X 

+ 



f 

Jo 



St_ 1 (t,x)dx- 
Li (x) S k (t, x) dx 



+oo 



Sk (t, x) dx 



fj,(x)S k +i (t,x)dx 



(3) 



Using a similar analysis to that for deriving Equation ([3]) , we can easily obtain a system 
of integral-differential equations for the fraction density vector S (t, x) as follows: 



S (t) = 1 for all t > 0, 



dt 



So (t) = -XS* (t) + 



\x (x) Si (t, x) dx, 



(4) 
(5) 
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d f n +0 ° 5i (t, x) dx , , , I 

V 7 — =\S$(t)-\ Sf(t,x)dx 



o 



dt 

-oo /•+00 

/U (x) Si (i, x) dx + / n (x) S2 (t, x) dx, (6) 
Jo 



and for k > 2, 



d/ oo g A; (t,x)dx_ x , , , 



df 



A / (t, x) dx - A / (i, x) dx 



hoc 



Jo 

00 f+00 

fi(x) S k (t,x)dx + / /u (x) 5fe+i (i, x) dx. (7) 
'o Jo 

Remark 1 When there are n servers in the supermarket model, it is necessary to give a 
finite-size system of integral- differential equations for the fraction density vector (t,x) = 
(so, n (t) , si, n (J,x) s n , n (t, x)) as follows: 

s o,n (t) = 1 for all t > 0, 
d f +oc 

-^S , n (t) = -XsQ n (t) + J /X (x) Si tn (t, x) dx, 



d/ + °°si,n (t,x) dx , 



H,n (*) - A / 4,n (t, X) dx 







dt 

-OO /"+OO 

M (x) si n (t, x) da; + / n(x) s 2 , n (t,x) dx, 



JO 



-00 p+00 
„d u „\ j„ \ / „d 



and /or n > k > 2, 

*f + °°s k At,x)dx =x ^ ^ { ^ x)dx - X J o si n (t, x) dx 

hoo r+00 

fi(x) s k , n (t,x) dx + / n(x)s k+ i, n (t,x) dx. 
Jo 

3 Doubly Exponential Solution 

In this section, we discuss the fixed point of the system of integral-differential equations in 
Equations ([3]) to ([Tj). and set up a system of nonlinear equations satisfied by the fixed point. 
Also, we provide a closed-form solution: doubly exponential structure, to the system of 
nonlinear equations. 

A row vector it (x) = (ttq, m (x) , 7r2 (x) , . . .) is called a fixed point of the fraction 
density vector S (t, x) = (Sq (t) , Si (t, x) , S2 [t, x) , . . .) if there exists a to > such that 
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So (t) = ttq and Sk (t, x) = ir^ (x) for all t > to and k > 1. It is easy to see that if ir (x) is 
a fixed point of the fraction density vector 5 (t, x) for all t > to, then 

^o(t)|^ =0 



and for k > 1 



which leads to 



Since for k > 1 



/•+oo d 

y d 7 Sfc ^ x )i*>*o d2; = - ( 8 ) 



0<S fc (i,x)<l, 



using the Dominated Convergence Theorem we obtain 



d 

dt 



S k {t,x)\t>t o dx = - 



Therefore, if ir (x) = (7ro,vri (x) , %i (x) ,.. .) is a fixed point of the fraction density vec- 
tor S (t, x) = {So (t) , Si (t, x) , S2 (t, x) , . . .) for all t > to, then the system of integral- 
differential equations ([!]) to (J7|) can be simplified as 

^0 = 1 (9) 
r+00 

- Att^ + / (i (x) 7Ti (a?) dx = 0, (10) 
Jo 

r+00 r+00 r+00 

\TT$(t)-\ nf(x)dx- fj, (x) m (x) dx + / fi (x) vr 2 (x) dx = 0, (11) 

Jo Jo Jo 

and for k > 2, 

r+00 r+00 r+00 r+00 

^ / ^fc-i ( x ) dx — A / 7rf(x)dx— / /i (x) ir^ (x) dx+ / \i (x) 7Tfc +1 (x) dx = 0. 
Vo Vo ■/ Jo 

(12) 

In what follows we derive a closed- form expression for ir (x) = (ttq, tt\ (x) , 7T2 (x) ,...). 
It follows from Equations © and (|10p that 







/x (x) 7Ti (x) dx = A. (13) 
To solve Equation (Tl3|) , using the fact that f Q + °° M (x) G (x)dx = 1 we have 

mix) = XG(x) = P -nG{x). (14) 
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Based on the fact that ttq = 1 and (x) = p ■ pG (x), it follows from Equations (fTT|) and 
(TT3D that 



-oo 



-A/ - / [ / uG(x)] d dx+ / p (x) tt 2 (x) dx = 0. 

J J 

Let = J +o ° [/iG (x)] rf dx, and we assume that < 9 < +oo. Then 

+oo 

p (x) 7T 2 (x) dx = \9p d . (15) 



Using a similar analysis on Equation (fT5|) . we have 

vr 2 (x) = X6p d G (x) = • pG (x) . (16) 

Based on tt\ (x) = p ■ pG (x) and 1T2 (x) = 6p d+1 ■ pG (x), we can compute 

r+00 

X irf (x) dx = \6p d , 
Jo 

r+00 r+00 

/ p (x) 7r 2 (x) dx = 9p d+l p / p(x)G (x) dx = A0p d 
Jo Jo 

and 

r+00 r+00 
A / Trf (x) dx = X9 d p d2+d / [ M G (x)] dx = \6 d+1 p d2+d , 
Jo Jo 

thus it follows from Equation (|12p that for k = 2, 

p (X) 7T 3 (X) dx = X9 d+1 p d2+d , 



which leads to 

7T 3 (x) = 9 d+1 p d2+d G (x) = e d+l p d2+d+1 ■ pG (x) . (17) 

Based on the above analysis for the simple expressions TTk (x) for k = 1,2 and 3, we 
can summarize the following theorem. 

Theorem 1 The fixed point n = (ttq, 7Ti (x) , 1T2 (x) , • • •) is given by 

tto = 1, 

7Tl (x) = p ■ pG (x) 

and for k > 2, 

vr, ( x ) = ^- a +d*- 8 +-+l/- 1 +d*- a +-+l . {x) j (18) 



07' 



vr fc (x) = 6>"^^p^ • /jG(x) . (19) 
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Proof By induction, one can easily derive the above result. 

It is clear from (|16p and (|17p that Equation (|18p or (|19p is correct for the cases with 
I = 2,3. Now, we assume that Equation (fT9j) is correct for the cases with I = k. Then 



and 



A / 7rfe_! (x) dx = A6> <*-i p d -i , 
o 



-°° rffc- 1 -! d fc -d 

p{x)^k{x)dx = \6 d ~ 1 /3 d - 1 



- x d fc -l d^-d 







A/ 7rf (x) dx = Xe'd-i p ' d-i ~ } 
Jo 

it follows from Equation (|12p that 



p (x) vTfc + i (x) dx = \6 d ~ 1 p d - 

Thus, for I = k + 1 we have 



o 



d h -l d k + 1 -l 



■K k +i(x) =9d-i p d-i ■ pG{x). 

This completes the proof. I 
Let 9 = Jq + °° [G(x)] rf dx. Then 6 = p d 9. The following corollary provides another 
expression for the fixed point. 

Corollary 2 



and for k > 1 



7T = 1 



vr fc (x) = A^ 1 • <j O^r^G (x) 



It is easy to see from Corollary [2] that the fixed point is decomposited into two groups 
of information under a product form: the arrival information and the service information. 
At the same time, the service information indicates that the doubly exponential solution 
to the fixed point must exist for < p < +oo, even if the service times are heavy-tailed. 

The following corollary provides an upper bound for the fixed point. 

Corollary 3 For k > 1 and x > 0, 



r+co dfc -i_ 1 A or 

7T fc (x)< / n k (x)dx<p . 

Jo V 
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Proof: Note that < G (x) < 1, we have 



[G(x)] dx < / G(x)dx = -. 
o Jo M 



It follows from Corollary [2] that 



d fc -l~d fc -!-l_ 



. A' 



7T fc (x)< / 7r fc (x)dx< / A d -! 6* <*-i G (x) dx = p . 

This completes the proof. ■ 
Now, we compute the expected sojourn time which a tagged arriving customer 
spends in the supermarket model. For the general service times, a tagged arriving customer 
is the Arth customer in the corresponding queue with the following probability 



d k - 2 -l d k ~ 1 -l rf fe" 1 -! d k -l 

d-1 n d-1 



7r£(x)dX = d-1 p d ~l -6 d-1 p 



'0 JO 

When k > 1, the head customer in the queue has been served, and so its service time is 
residual and is denoted as Xr. Under the stationary setting, we have 



P{X R <x}= [pG(y)]dy 
Jo 



with 



E[X R ] 



oo r+oo 



[fiG (y)] dydx. 



'0 Jx 

Thus it is easy to see that the expected sojourn time of the tagged arriving customer is 
given by 



E[T d 



+E 

k=l 



4 (x) dx 



4 {x) dx 



E[X] 

•+oo 





oo 



4+1 (x) dx 







[E [X R ] + kE [X]] 



4 (x) dx 



r+oo 

E[X]+ / 4 (x) dxE [X R ] 
Jo 

°° r r+oo r+oo 

+ E[X]Y,k / 4(x)dx- / 4 +1 (x)dx 
k=i >-Jo Jo 

r+oo J 00 r+oo J 

{E [X R ] - E [X]} I 4 (x) dx + E [X] |l + J2 1 < (*) 



: {E[Xr]-E[X]} + E[X] 



.fc=l 



d-1 n d-1 
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If the service times are exponential, then E [Xr\ = E [X] , thus we obtain 



E[T ( 



1 

d\ = ~ 



.k=l 



P 



which is the same as Corollary 3.8 in Mitzenmacher [20J. 

We consider a computational example for the expected sojourn time in the supermarket 
model with an Erlang service time distribution E(m,p,), where m = 2, p, = 1, d = 2. 
Figure 3 shows how the the expected sojourn time depends on the arrival rate. 
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Figure 2: the expected sojourn time E [TJ depends on the arrival rate A 



With the results from Equation (|18p or (|19p , let us now provide some useful discussions 
on the asymptotic behavior of the fixed point ir [x) = (7To,vri (x) ,7T2 (x) ,...). Note that 
we express a& ^ O if limjfc_ ) . 00 a^/bk = c S (— oo, 0) U (0, +oo). 

Remark 2 If the general distribution G (x) and its mean 1/p are given, then 8 = Jq + °° [pG (: 
is a deterministic factor. We have 

' T; ! , ! - O (p^) pG(x), ask^oo. 



In this case, the heavy traffic should have a bigger influence on the asymptotic behavior of 

the sequence < 

I d-i 

Remark 3 If p is given, then 



nk W - o( O^^ 1 ) pG (x) , as k -> oo. 



d fc -l 
l d-1 
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In this case, the maximal value 9 max of the positive number Jq + °° [/uG(x)] d rfx should have 
a bigger influence on the asymptotic behavior of the sequence < > . 

4 A discussion for the key parameter 9 

In this section, we provide a necessary discussion for the key parameter 9 in the doubly 
exponential solution of Theorem [TJ Based on this, for the fixed point we give a new and 
important observation: the doubly exponential solution to the fixed point can extensively 
exist for < /i < +00, even if the service time distribution is heavy-tailed. 
Note that 



r+00 

/ [fiG{x)] dx 
Jo 



/rgwTjf, (20) 

it is easy to see that 9 = 1 if d = 1. Thus, we need to analyze the case for k > 2 as follows. 
Since < G (x) < 1, we get that < \G (x)] d <G(x)< 1, which leads to 

"+00 



r+00 /"+00 

/ [G(x)] dx < G{x)dx = 1/fx. 
Jo Jo 



It is easy to see that < 9 < and thus if < fi < +00, then < 9 < +00. 

In what follows we analyze five simple and useful examples. In first two examples, the 
service time distribution is light-tailed; while in the last three examples, the service time 
distribution is heavy-tailed. Specifically, the examples with heavy-tailed service times 
illustrate two important observations: the first one indicates that the fixed point for the 
supermarket model is different from the tail of stationary queue length distribution for 
the ordinary M/G/l queue, and the second one is to show that the doubly exponential 
solution to the fixed point can exist extensively if the service time mean is non-zero and 
finite. 

Example one: Exponential distribution. Let G (x) = e~^ x . Then 9 = [i d ~ 1 /d. It is 
easy to see that when > d ~J/d, 9 > 1; when [i = d ~J/d, 9 = 1; and when fi < d ~J/d, 
< 9 < 1. If d = 2, then 9 is a linear function of /i, and if d = 3, then 9 is a nonlinear 
function of fi. Figures 3 and 4 show the functions 9 = fi/2 and 9 = fj? /3, respectively. 
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Figure 3: 9 is a linear function of ji for d = 2 




Figure 4: 9 is a nonlinear function of \x for d = 3 



Example two: Erlang distribution E(m,fi). Let G (x) = e Mrr Z^fcLo ^fc? • Then 9 
is given by 



/' \ d f g—fidx 



.fc=0 



fc! 



dec. 



Let fj,= 1. Table 1 lists how depends on the parameter pair (m, d). As seen from Table 
1, 9 is decreasing for each of the two parameters m and d. 



Table 1: 9 depends on the Erlang parameter pair (m,d) 



(m, d) 


(2, 2) 


(2, 5) 


(2, 10) 


(5, 2) 


(10, 2) 


(5, 5) 


(10, 10) 


9 


0.52 


0.19 


9.15 x 10~ 2 


4.13 x 10" 2 


9.48 x 10" 4 


1.11 x 10~ 3 


6.51 x 10~ 10 
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Example three: Weibull distribution W (t, yu). Let G (x) = exp{— (fit) T }. It is easy 
to check that the mean of the Weibull distribution is given by 



H \ T 



which follows that 9 is given by 



d-l 



£ [r(i + J)] 



d-l 



where T(a) = f Q 



e x dx. Obviously, the Weibull distribution W (r, fj,) is heavy- 



tailed if < r < 1; and the Weibull distribution W (t, fi) is light-tailed if r > 1. To 
indicate the role played by the heavy-tailed parameter r for < r < 1, taking fj, = 5 and 
d = 2 we have 



2±r(i + i) 

Table 2 indicates how 9 depends on the heavy-tailed parameter r, such as, < 9 < 1 if 
r = 0.2; > 1 if r = 0.9. This example, together with TheoremO] illustrates an important 
observation that the fixed point ir = (ttq, tt\ (x) , 1T2 (x) , . . .) is doubly exponential (clearly, 
it is light-tailed) even if the service time distribution is heavy-tailed. Based on this, the 
the fixed point is different from the tail of stationary queue length distribution of the 
ordinary M/G/l queue, since for the ordinary M/G/l queue, the stationary queue length 
distribution is heavy-tailed if the service time distribution is heavy-tailed, e.g., see Adler, 
Feldman and Taqqu [lj. 

Table 2: 9 depends on the heavy-tailed parameter r for < r < 1 



T 


0.2 


0.3 


0.4 


0.5 


0.6 


0.7 


0.8 


0.9 


9 


1.3 x 10~ 3 


5.3 x 10~ 2 


0.27 


0.63 


1.05 


1.47 


1.86 


2.19 



Example four: Power law distribution. Let G (x) = (/u + x)~ Q . If < a < 1, 
then the power law distribution does not exist the finite mean. In this case, we can not 
setup the system of integral-differential equations for the fraction density vector S (t, x) = 
(So (t) , Si (t, x) , S2 (t, x) ,...) which leads to the analysis for the fixed point. Thus we 
only deal with the case with a > 1. Note that for each a > 1 



G (x) dx 



1 
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and 




thus we obtain 9 = fi d 1 . It is easy to see that when \i > 1, 9 > 1; when pi = 1, 9 = 1; 
and when O</x<1,O<0<1. It follows from Theorem [T] that for k > 1 

TTfc (x) = fjf'^ptt • /xG(x) . 

This indicates that the fixed point ir = (7ro,7ri (x) , 7T2 (x) ,.. .) is doubly exponential (of 
course, it is light-tailed) if the service time distribution is power law. 

Example five: Almost exponential distribution. Let G{x) = exp {— x (lnx)~°}. 
Then it is easy to see that the almost exponential distribution is heavy-tailed if a > 

J* +o ° exp {— dx (lnx) _a } dx 

= ~n^> ~ — 1^ 

J Q °° exp { — x (In x) a } dx 

Table 3 lists how 9 depends on the parameter pair (d, a). As seen from Table 3, 9 is 
decreasing for each of the two parameters d and a. 



Table 3: 9 depends on the parameter pair (d, a) 



(d, a) 


(2, 2) 


(4, 2) 


(2, 4) 


(4, 4) 


9 


2.24 x 1(T 2 


2.01 x 10" 4 


3.44 x 1(T 5 


1.18 x 1(T 13 



5 The key parameter 6 for PH Service Times 

In this section, as an important example we provide three methods to analyze a super- 
market model with Poisson arrivals and PH service times. Our purpose is to provide three 
different ways to determine the key parameter 9 and compute the doubly exponential 
solution to the fixed point. Also, we indicate that the doubly exponential solution to the 
fixed point is not unique for a more general supermarket model. 

The supermarket model with Poisson arrivals and PH service times is described as 
follows. Customers arrive at a queueing system of n > 1 servers as a Poisson process with 
arrival rate n\ for A > 0. The service times of these customers are of phase type with 
irreducible representation (a, T) of order m. Each arriving customer chooses d > 1 servers 
independently and uniformly at random from these n servers, and waits for service at the 
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server which currently contains the fewest number of customers. If there is a tie, servers 
with the fewest number of customers will be chosen randomly. All customers in any service 
center will be served in the FCFS manner. For the PH service time distribution, we use 
the irreducible representation (a, T) of order m, where the row vector a is a probability 
vector whose jth entry is the probability that a service begins in phase j for 1 < j < m; 
and T is a matrix of order m whose (i,j) th entry is denoted by tij with ij j < for 
1 < i < m, and tij > for 1 < i,j < m and i ^ j. Let T° = —Te ^ 0, where e is a 
column vector of ones with a suitable dimension in the context. When a PH service time 
is in phase i, the transition rate from phase i to phase j is tij, the service completion rate 
is t®. At the same time, the mean service rate is given by 

1 

H = -- 



Unless we state otherwise, we assume that all the random variables defined above are 
independent, and that the system is operating at the stable region: p = A//x < 1. 

We introduce some useful notation. Let (t) be the number of queues with at least 
k customers and the service time in phase i at time t > 0. Clearly, < (t) < n for 
1 < i < m and < k < n. We define 

^w = =^, 

n 

which is the fraction of queues with at least k customers and the service time in phase i. 
We write 

So (*) = (*<) (*)) 

and for k > 1, 

s k (t) = (4 1} (t) , 4 2) (*).-, 4 m) (*)) . 

S(t) = (S (t),S 1 (t),S 2 (t),...). 
We now introduce Hadamard Product of two matrices A = (ciij) and B = (bij) as follows: 

AQB = (oijfeij). 

Specifically, for k > 2 we have 

A Qk = A A • • • A. 

V v ' 

k matrix A 
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Let a = (01,02,03, . . .). We write 



o ^ = (of, of, of,. 

Using a similar analysis to that in Equations @ to ([7]), we can obtain the fol- 
lowing systems of differential vector equations for the fraction density vector S (t) = 
(S„(t),Si (t),S 2 (t),...). 

S (t) = 1, for t > 0, (21) 
±S (t) = -\S° d (t) + S 1 (t)T°, (22) 

^Si (t) = AaS o 0d (t) - XSf d (t) + Si (t) T + 5 2 (t) T°a, (23) 

and for k > 2, 

(t) = AS®^ (t) - A5 ed (t) + 5 fc (t) T + (i) T°a. (24) 

If 7T = (-7To, 7Ti, 7T2, . . .) is a fixed point of the fraction density vector S(t), then the 
system of differential vector equations (I21|) to f|24jl can be simplified as 

^0 = 1 (25) 

- Avr 0d + mT° = 0, (26) 

Aavr 0d - Avr 0d + vriT + vr 2 T a = 0, (27) 

and for k > 2, 

Att®^ - A7T Qd + vr fc T + 7r k+1 T a = 0. (28) 

In what follows we provide three methods to solve the system of nonlinear equations 
(|25j) to (|28]) . and give three different doubly exponential solutions to the fixed point. 

5.1 The first method 

The first method is based on Theorem [1] given in this paper. For the PH service time 
distribution 

G (x) = a exp {Tx} e 

Let 6 = Jq + °° [/iG (x)] rf dx, and we assume that < 6 < +00. Then the fixed point 
7r = (7T , 7Ti (x) , 7T 2 (x) , . . .) is given by 

vro = 1, 

and for k > 1 

vr fc ( x ) = e^r^p^ ■ /iG (x) . (29) 



111 
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5.2 The second method 

The second method is proposed in Li, Wang and Liu [llj . and the key parameter 9 is 
based on the stationary probability vector u of the irreducible Markov chain T + T°a, 
that is, 9 = uj &d e. 

It follows from Equation (|26|) that 

vnT = A. 

Note that 

loT° = p, 

-ojT° = A. (30) 

Thus, we obtain 

A 

7Ti = — CO = p ■ 0J. 

Based on the fact that ttq = 1 and n± = p • w, it follows from Equation (f2T|) that 

Aa - \p d ■ oj &d + p ■ uT + ir 2 T°a = 0, 

which leads to 

A - Xp d • u &d e + p • wTe + ^ 2 T° = 0. 
Note that coTe = —p and p = \/p, we obtain 

7T 2 T° = AA 0d e. 
Let 6 = oj Qd e. Then it is easy to see that 6 G (0, 1), and 

tt 2 T° = \6p d . 

Using a similar analysis on Equation (|3U|) . we have 

^P d a d+l 

7T 2 = — UJ = 8p a+L ■ CO. 

Based on tt\ = poj and 7T2 = 6p d+1 ■ oj, it follows from Equation (|28[) that for k = 2, 
A/ • w 0d - \9 d p d2+d ■ u &d + • ujT + ^ 3 T°a = 0, 

which leads to 

\9p d - X9 d+1 p d2+d + 9p d+1 ■ uTe + ir 3 T° = 0, 
21 



thus we obtain 



n 3 T° = \6 d+1 p d2+d . 



Using a similar analysis on Equation ()30|) . we have 

\ad+l „d 2 +d 

AV p d+l J2 +d+1 

7T3 — UJ — U p ■ UJ, 

d fc -l_i d k -l 

Now, we assume that TTk = 9 d ~ 1 p d ~ 1 ■ oj is correct for the cases with I = k. Then it 
follows from Equation (|28|) that for I = k + 1, we have 

^Qd k - 2 +d k -' i + - +dpd k - 1 +d k - 2 +---+d _ w 0d _ ^Qd k - 1 +d k -' 2 +-+d pd k +d k - 1 +---+d _ ^Qd 

+ 0d k -2 +d »-3 + ... +lpdk -l +d *-* + ... +1 . ^ + 7rfe+lT a = 0j 

which leads to 

^Qd k - 2 +d k - 3 + ---+d+lpd k - 1 +d k ~ 2 +---+d _ ^Qd k - 1 +d k - 2 + - +d+l pd k +d k ~ 1 + ---+d 

+ ed ^ +d kS + ... +lpd k-, +d k-2 + ... +1 ^ + = Qj 



TTfc+l-t = AC/ p 



thus we obtain 



By a similar analysis to (|30p . we have 

^^d fe - 1 +d fc - 2 H hd+lpd fc +d' :_1 H 

TT k+ i = OJ 

_ od k - 1 +d k ~ 2 -{ \-d+l n d k +d k ~ 1 +--+d+l , , 

— U p • OJ. 

Therefore, by induction the fixed point tt = (ttq, 7Ti, 7T2, . . .) is given by 

tto = 1, 

and for k > 1 

TTfc = 9 d -! p d "! • OJ. (31) 

5.3 The third method 

The third method is based on the matrix computation for the system of nonlinear equations 
(|25p to (|28|) . and shows that the key parameter 9 is based on the initial probability vector 
a in the PH service time distribution, that is, 9 = l/a®de. 
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It follows from (j25|) to l|28j) that 



Qd Qd Qd 



(Aq,0,0,...), 



which leads to 



-A A 



-A A 



-A A 



+ (711,^2)^35 . . .) 



T 

T°a T 

T°a T 



( R V 

R V 
R V 

V 



J * * * I 5 



where 



and 



Thus we obtain 



+ (Aa(-r)" 1 ,0,0, 

v = x(-ry 1 

R = A(-/ + ea)(-r) _1 . 
TTi = Aa (-T)" 1 + vrf d [a (-/ + ea) (-T)" 1 



and for k > 2 



A (-T)- 1 ! + [A (-J + ea) (-T) -1 



(32) 



(33) 



To omit the term 7T? d 
the following expression 



A {—I + ea) (— T) 1 for A; > 1, we assume that {7Tfc, > 1} has 
TTfc = r (&) a rf. 



In this case, we have 



7T 



0ti 



A(-J + ea) (-T)' 1 = r d (k)a X(-I + ea)(-T) 



v-1 



thus it follows from (1321) and (1331) that 



7Ti = Aa (— T) 1 



(34) 
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and for k > 2 



It follows from (01) that 



which follows that 



where 



It follows from (1351) that 



A(-ry 

r(l)a ^ = Xai-T)- 1 , 
r(l) = 0p, 



(35) 



0i ' 



r(/t)a s =r d (k- I) a A(-T)" 1 



which follows that 



Therefore, we can obtain 



and for k > 1 



5.4 Non-uniqueness 



r{k) = r d (k-l)9p= [9p)—- 



7T = 1 



d -1 „ 1 



(36) 



Based on the above three methods, we can summarize the key parameter and the doubly 
exponential solution to the fixed point in the following table. 

Table 4: Comparison for the three methods 





Key Parameter 


Fixed point 


Method 1 


/+ 00 [a«p{Tx} e ] <i d a! 


d fc_1 -l d fc -l 

TT k = 9 d_1 P d " 1 • pG (x) 


Method 2 


9 = u ed e 


d fc ~ 1 -l d fc -l 

TX k = 9 d -! p d - 1 • UJ 


Method 3 


9 = l/a Q h 


d k -l l 

ir k = {Op) d-i . a w d 



When the PH service time is an m-order Erlang distribution with the irreducible 
representation (a,T), where 

a = (1,0,. ..,0) 
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and 



-rj t] 



\ 



-7] 7] 



rpO 
1 1 



-T] 7] 



We have 



and 



-r, J 



= (1,0,..., 0) 



1. 









K v J 



v© 



a <ie 

Thus the doubly exponential solution by the third method is given by 



TT k = p— • (1,0,...,0), k>l. 



(37) 



It is clear that 



T + T°a 



-7] 7] 



—rj 7] 

\ V -v J 

which leads to the stationary probability vector of the Markov chain T + T°a as follows: 

1 1 1 



to 



fi = ujT = — , 
m 



A mA 

fl 7] 



and 



uj &d e = m f — ) = m x - d 
m 



Thus the doubly exponential solution by the second method is given by 



rffc- 1 -! d k -l ( 1 1 
7Tfc = 6 d- 1 p d-1 



1 



p d-i ■ I m 



-d k ~ 



, m 



, m 



-d k ~ 



, k> 1. 



(38) 



It is clear that the three doubly exponential solutions ([29]) . ([3?]) and (|3"5j) are different for 
m > 2. 
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Remark 4 For the supermarket model with Poisson arrivals and PH service times, we 
have obtained three different doubly exponential solutions to the fixed point. It is interesting 
but difficult how to be able to find another new doubly exponential solution. We believe 
that it is an open problem how to give all the doubly exponential solutions to the fixed point 
for a more general supermarket model including the case with MAP arrivals, PH service 
times or general service times. 

6 Exponential convergence to the fixed point 

In this section, we study the exponential convergence of the current location S (t, x) of 
the supermarket model to its fixed point ir (x) for t > and x > 0. Not only does the 
exponential convergence indicates the existence of the fixed point, but it also explains such 
a convergent process is very fast. 

For the supermarket model, the initial point S (0, x) can affect the current location 
S (t,x) for each t > 0, since the service process in the supermarket model is under a unified 
structure. Here, we provide notation for comparison of two vectors. Let a = (oi, 02) 03, . . .) 
and b = (&i,&2;&3> • • •)• We write a -< b if < b^ for all k > 1; a ^ b if aj. < bk for all 
k > 1. 

Now, we can obtain the following useful proposition whose proof is clear from a sample 
path analysis and is omitted here. 

Proposition 2 If S (0, x) ±S(0,x), then S (t,x) H S (t,x). 

Based on Proposition [2j the following theorem shows that the fixed point ir (x) is an 
upper bound of the current location S (t, x) for alH > and x > 0. 

Theorem 4 For the supermarket model, if there exists some k such that Sk (0, x) = 0, 
then the sequence {Sk (t,x)} has a upper bound sequence which decreases doubly exponen- 
tially for all t > and x > 0, that is, S (t, x) < ir (x) for all t > and x > 0. 

Proof Let 

S (0) = 7T 

S k (0,X) = TT k (x) , k > 1. 

Then So (t) = So (0) = ttq, and for each k > 1, Sk (t, x) = Sk (0, x) = iik (x) for all t > 
and x > 0, since S (0) is a fixed point in the supermarket model. If Sk (0, x) = for 
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some k, then S k (0, x) < Sk (0, x) and Sj (0, x) < Sj (0, x) for all j > 1 and j 7^ fc, thus 
5(0, x) ^ 5(0, z). It is easy to see from Proposition [2] that S k (t,x) < Sk {t,x) = ir k (x) 
for all k > 1, t > and x > 0. Thus we obtain that for all > 1, t > and x > 

5 fc (i,x) < vr fc (x) = e^^p^r . [pG (x)] . 

This completes the proof. ■ 

To show the exponential convergence, we use Theorem |4] to define a potential function 
(or Lyapunov function) <1> (t) as follows: 



00 r+00 
$ (t) = S2 w k \ [vr fc (x) - Sk {t, x)] dx, 
fc=l ^ 



where {wk} is a positive scalar sequence with Wk > Wk~i > w± = 1 for k > 2. Note that 
7To = So (i) = 1. It is easy to see from Proposition [2] that $ (t) > for all i > 0. 
When J +o ° [vrfc (x) — Sk (t, x)]dx > for k > 1, we write 

Jo [7r fc (x) - S fc (t, x)] dx 

and 

Jo +0 ° M (g) 5 fc (*, x) dx _ 

.fo + °° ( x ) ~ ^ (*' x )] d:r 
The following lemma provide a method to determine the positive scalar sequence {wk} 

with Wk > Wk-i > W\ = 1 for k > 2. This proof is easy by means of some simple 

computation. 

Lemma 2 If S is a positive constant, 

wi = 1, 
A (w\ — W2) c\ (t) = —5wi 

and for k > 2 

A - w k+ i) c k (t) + (tOfe - w k -i) d k (t) = -Sw k , 

then 

5 

W 2 = 1 + 



A C1 (i) ' 
and /or /c > 3 

(5w fc _i + (w k -i - w k -2) 4-1 (*) 



Acfc_i (t) 
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The following theorem measures the distance (t) of the current location S (t, x) for 
t > and the fixed point it (x) for x > 0, and illustrates that the distance <3? (t) to the fixed 
point from the current location is very go to zero with exponential convergence. Hence, it 
shows that from any suitable starting point, the supermarket model can be quickly close 
to the fixed point, that is, there always exists a fixed point in the supermarket model. 

Theorem 5 For t > 0, 



where cq and 5 are two positive constants, and they possibly depend on time t > 0. In this 
case, the potential function <3? (t) is exponentially convergent. 

Proof Note that 



$ (*) < c e 




fe=i 



we have 





by means of the Dominated Convergence Theorem. It follows from @ to ([7]) that 



L 



(x) Si (t, x) dx = A, 



(39) 
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and using (|39j) we obtain 

f +00 



d d r+°° 

T *(t)=-J2 Wk - S k (t,x)dx 

k=i J{i 



" + OO 

u;i[A-A / Sf(t,x)dx 




which follows 

d 



00 r+00 

li (x) S\ (t, x) dx + n (x) S2 {t, x) dx] 
Jo 
00 r+00 r+00 

Y^w k [\ St, (t , x) dx - A / Sf (t, x) dx 

k=2 Jo Jo 
r+00 r+00 
/ n(x) S k {t,x) dx + / fi (x) S fc +i (t, x) dx] 
Jo Jo 

r+00 r+00 

wi[-X / Sf(t,x)dx+ / fj, (x) S 2 (t, x) dx] 
Jo Jo 

00 r+00 r+00 

V w k [A / S%_ x (t, x) dx - A / Si(t, x) dx 

k=2 Jo Jo 
+00 r+00 

fi (x) S k (t,x)dx + n (x) S k+ i (t, x) dx] , 

Jo 



+00 

$ (i) =A (wi - w 2 ) ci (t) I [ir k (x) - S k (t, x)] dx 





dt 

+ 22 [A (w k - w k+ i) c fc (t) + (w k - w k -i) d k (t)] 

k=2 
r+00 

■ / kfc (a?) - S k (t,x)]dx. 
Jo 

Using Lemma [2] we can easily choose a parameter 5 > and a suitable positive scalar 
sequence {w k } with > w k -\ > w\ = 1 for k > 2 such that 

A (it?! — W2) ci (i) < — (5wi 

and for k > 2 

(u; fc - iOfc_i) 4 (t) - A (w k+1 - Wk) c k (t) < -5w k , 

thus we can obtain 
which leads to 

*(t) <c e- 5 *. 

This completes the proof. ■ 
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Remark 5 We have provided an algorithm for computing the positive scalar sequence 
{u>k} with 1 = w\ < u>k-i < Wk for k > 2 as follows: 
Step one: 

ui\ = 1. 

Step two: 

5 

W2 = 1 + 



Aci (t) ' 
Step three: for k > 2 

, Sw k -x + (w fc _i - w fc _ 2 ) 4-1 0) 

u> fc = tyjfc-i H t-7 . 

Ac fc -i (t) 

T/iis illustrates that wt is a function of time t. Note that X,5,Ck (t) ,di (t) > 0, it is clear 
that for k > 2 

1 = W\ < W k -1 < w k - 



7 Lipschitz Condition 

In this section, we apply the Kurtz Theorem to study the supermarket model with general 
service times, and analyze the Lipschitz condition with respect to general service times. 

The supermarket model can be analyzed by a density dependent jump Markov process, 
where the density dependent jump Markov process is a Markov process with a single 
parameter n which corresponds to the population size. Kurtz's work provides a basis for 
the density dependent jump Markov processes in order to relate the infinite-size system 
of differential equations to the corresponding finite-size system of differential equations. 
Readers may refer to Kurtz [9j for more details. 

In the supermarket model, the states of density dependent jump Markov process can be 
normalized and interpreted as measuring population densities, so that the transition rates 
depend only on these densities. Hence, the infinite-size system of differential equations 
can be regarded as the limiting model of the corresponding finite-size system of differential 
equations as the population size grows arbitrarily large. When the population size is re, 
we write 

E n = {k:k = 0,l,...,n}. 

For k > 1 and x > 0, we write 
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where x is the residual service time of each server, and 

"+OO 



» 



s[ n ^ (x) dx. 







Let 



and for k > 1 



5 = lim 4 n) 

n— >oo 



5fc = lim / 4 (x) dx. 
/o 



Let {x n (t) : t > 0} be a density dependent jump Markov process on the state space 
E n whose transition rates are given by 



1k,k+l ~ n Pl 



n 



In this supermarket model, X n [t) is the unsealed process which records the number of 
servers with at least k customers for < k < n. 

Let a and b denote an arrival and a service completion, respectively. Hence taking 
I = a or b for a > b > 0, we write 



M4 n) 



/M4 n) 



» 



Pa K 



'0 

A- A 



A, 



jjL (x) 4 ( x ) dx; 







dx, 



Pb (4 

and for n > k > 2 



(n) 



°° fn) /" +0 ° (W) 

/i (x) 4 (x) dx + / (x) (x) dx; 

JO 



& (4"') 



4"\ w 



/i (x) 4 {x) dx + / /j, (x) (x) dx. 
' Jo 



dx — A 



» 



dx, 



Using Chapter 7 in Kurtz [U] or Subsection 3.4.1 in Mitzenmacher [20J, the Markov 
process |x n (t) : t > j with transition rates 4"fc+z * s gi ven by 



= X n (0)+ IY 1 [nf Pi 



X n {u) 



du 



l=a,b 



n 



(40) 
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due to the fact that 



where Yi (x) for I = a and b are two independent standard Poisson processes. Clearly, the 
jump Markov process by Equation (j40j) at time t is determined by the starting point and 
the transition rates which are integrated over its history. 
Let 

F (y) = a(3 a (y) + bp b (y) . (41) 
Taking X n (t) = n~ x X n (i) which is an appropriate scaled process, we have 

X n (t) = X n (0) + V ln- l Yi (n f A {X n (u)) tin) + f F (X n («)) du, (42) 

l=a,b V J ° / J ° 

where Y\ (y) = Y\ (y) — y is a Poisson process centered at its expectation. Note that in 
(142p . the function F (y) given in (]4ip is for y = s[ n ' ) , < k < n. 

Taking X (t) = lim n ^ QO X n (t) and xq = lim n ^. 0O X n (0), we obtain 

X{t)=x +[ F(X(u))du, t>0, (43) 
Jo 

lim -11 fn f ^(X n (u))du) =0 

n^oo n \ Jq J 

by means of the law of large numbers. Note that in (|43l) . the function i 7 (y) given in (|41[) 
is for y = Sk,k > 1. In the supermarket model, the deterministic and continuous process 
{X (t) ,t > 0} is described by the infinite-size system of integral-differential equations Q 
to (|7|), or simply in the below 

jX(t) = F(X(t)) (44) 

with the initial condition 

X (0) = x . (45) 

Now, we consider the uniqueness of the limiting deterministic process {X (t) ,t > 0} 
with (|44p to ()45p . or the uniqueness of solution to the infinite-size system of integral- 
differential equations @ to ([7]). To that end, a sufficient condition is Lipschitz, that is, 
for some constant M > 0, 

\F(y)-F(z)\<M\y-z\. 

In general, the Lipschitz condition is standard and sufficient for the uniqueness of solution 
to the finite-size system of differential equations; while for the countable infinite-size case, 
readers may refer to Theorem 3.2 in Deimling [3] and Subsection 3.4.1 in Mitzenmacher 
|20j for some generalization. 
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To check the Lipschitz condition, as n — > oo we have 



Pa (So) = -A, 



-oo 



Pb(So)= I fi (x) Si (x) dx; 

"+OO 







Pa(S 1 ) = \-\l [Sx(x)] d dx, 







(3b(Si) = — / fj, (x) Si (x) dx + / n (x) S 2 (x) dx] 
Jo Jo 



+00 



and for k > 2, 



/3« (Sfc) = A / [S k _i (x)] dx - X [S k (x)] dx, 
Jo Jo 

r+00 r+00 

Pb(S k ) = - H (x) S k (x) dx + / n (x) S k +i (x) dx. 
Jo Jo 

Let 

L _ Jo + °° [S k (x)] d dx 
Jo + °° S k (x) dx 

and 



Io +0 ° V ( x ) ^ ( x ) dx 



Jo °° £& (x) dx 
Then Cfc, % > for k > 1. 

The following theorem shows that the supermarket model with general service times 
satisfies the Lipschitz condition for the infinite-size system of integral-differential equations 
© to ©. 

Theorem 6 The supermarket model with general service times satisfies the Lipschitz con- 
dition. 

Proof Let 

ft = {S k : k > 0} . 
For two arbitrary entries y, z G ft, we have 

\F (y) ~F(z)\< a\(3 a (y) - a (z) | + b\/3 b (y) - ft, (z) \. 

Now, we analyze the following four cases for the function /3 a (y), while the function 
ft (y) can be analyzed similarly. 
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Case one: y = Sq, z = S\. In this case, we have 



\Pa(v)-Pa(z)\ = \-\-\ + \ [Si (x)] d dx\ 

JO 
r+oo 

= A|2-Ci / S 1 (x)dx\ 
Jo 

r+oo 

= A 2 - Ci / Si (x) dx , 
Jo 



since < Ci, Jo + °° Si (x)dx < 1. Taking 



M a (0, 1) > 



2 -Ci/ +OO Si (x)dx 
2 - /+~ Si (x) dx ' 



it is clear that 



\(3 a (y) - P a (z) | < M a (0, 1) A 



r+oo 

/ Si (x) dx 
Jo 



= M a (0,l)\y-z\. 



Case two: y = So, z = S& for fc > 2. In this case, we have 

r+oo r+oo 

\(3 a (y) - (3 a (z) | = | - A - A / [S fc _! (x)] d dx + A / [S fc (x)] d dx| 

JO JO 

/>+oo /"+oo 

= A| — 1 — Cfc-i / S fe _i (x) dx + Ck I S fc (x) dx| 
Jo Jo 

r+oo r+oo 

1 + Cfc-i / S fe _i (x) dx - ( k / 5' fe (x)dx 
JO Jo 



= A 



due to that < £fc, Jo + °° ^ k ( x )^ x < 1- Let 



M a (0, fc) > 



1 + Cfc-1 Jo S k-l ( X ) dx - Cfc Jo ^ ( X ) dx 



1 + Jo + °° S k-i ( x ) dx - f +o ° Sfc (x) dx 



+oo 



Then 



\P a {y)-p a (z)\<M a (0,k)\ 



r+oo r+oo 

1+ / Sfc_i(x)dx- / Sfc(x)dx 

JO JO 



= M a (0,k)\y-z\. 
Case three: y = Si, z = Sfc for A; > 2. In this case, we have 

»+oo /"+0O 



r+oo r+oo r+oo 

\Pa (y) -Pa{z)\ = \\-\ [Si (x)] d dx - A / [S fe _i (x)] d dx + A / [S fc (x)] d dx| 

JO JO JO 

r+oo r+oo r+oo 

= A|l — Ci / Si(x)dx-Cfc-i / Sfc_i(x)dx + Cfc / Sfc(x)dx| 

JO JO JO 
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Let 

p+oo / \ i » r+oo 



M a (1, k) > 



1 ~ Ci Jq °° Si (x) dx - Ck-i f °° gfe-i 0*0 dx + Cfc Jq °° gfc 0*0 dxj 

r+oo rt / \ j r+oo rY / \ j r+oo 



1 1 ~ Jo °° 5 i ( x ) dx - Jo °° ^fc-i ( x ) dx + Jo °° 5 * ( x ) dx l 
Then 

r+oo r+oo r+oo 

\p a (y) - (3 a (z) | < M a (1, fc) A|l — / 5i (x) dx - / (x) dx + / 5 fe (x) dx| 

Jo Jo Jo 

= M a (l,k)\y-z\. 
Case four: y = Si, z = S k for k > / > 2. In this case, we have 

r+oo r+oo 



r+oo r+oo 

\Pa (V) - Pa (Z) | =|A / (x)] d dx - A / [5, (x)] d dx 
JO JO 

r+oo r+oo 

- A / [5 fc _i (x)} d dx + A / [5 fc (x)] d dx| 

Jo Jo 

r+oo r+oo 

=A|0-i / Si^ 1 (x)dx + Q S"z(x)dx 

JO JO 

r+oo r+oo 

- Cfc-i / S k - 1 (x)dx + Ck S k (x)dx\. 

Jo Jo 



Let 

r+oo ri / \ i . j. r+oo / \ , * r+oo 



IQ—i Jo °° Si-i jx) dx + Q / Q °° 5; (x) dx - Cfc-i Jo °° Sfc-i (x) dx + ( k J Q 00 g fc (x) dx| 

+OO a i \ j f+OO ry / \ j f+OO / \ J f+OO 



I J +o ° (x) dx + J +o ° 5, (x) dx - J +o ° Sfe-! (x) dx + J +o ° S fc (x) dx| 
Then 

\p a (y)-P a (z)\<M a (l,k)\y-z\. 
Based on the above four cases, taking 

M a = max {M a (I, k) : k > I > 0} 

we obtain that for two arbitrary entries y, z £ $7, 

IA, (y) - A. (*) I <M a \y-z\. 
Similarly, we can choose a positive number Mb such that for two arbitrary entries 

y,z e n, 

\Pb(v)-Pb(z)\<M b \y-z\. 
Let M = max {aM a , bM u }. Then for two arbitrary entries y, z G CI, 

\F(y)-F(z)\<M\y-z\. 
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This completes the proof. ■ 
Based on Theorem[6j the following theorem easily follows from Theorem 3.13 in Mitzen- 
macher |20|. 



Theorem 7 In the supermarket model with general service times, {X n (i)} and {X (t)} 
are respectively given by fcftfy an d (43\ )> we have 

lim sup \X n (u) — X (u) | = 0, a.s. 

n ^°° u<t 

Proof It is seen from that in the supermarket model with general service times, the 
function F (y) for y £ Q satisfies the Lipschitz condition. At the same time, it is easy to 
take a subset O* C Q such that 

{X (u) : u < t} C n* 

and 

a sup f3 a (y) + a sup /3 a (y) < +oo. 
yen* yen* 

Thus, this proof can easily be completed by means of Theorem 3.13 in Mitzenmacher [20J. 
This completes the proof. ■ 
Using Theorem 3.11 in Mitzenmacher [20] and Theorem we can obtain the follow- 
ing theorem for the expected sojourn time that a customer spends in an initially empty 
supermarket model with general service times over the time interval [0, T\. 

Theorem 8 In the supermarket model with general service times, the expected sojourn 
time that a customer spends in an initially empty system over the time interval [0, T] is 
bounded above by 



0p d {E[X R ]-E[X]} + E[X] 
where o(l) is understood as n — >• oo. 



d"-l d k -d 



E g — i c 
6 d-x p - 



d-l f) d-l 

k=l 



+ o(l) 



8 Concluding remarks 

In this paper, we provide a novel and simple approach to study the randomized load 
balancing model with general service times, which is described as an infinite-size system 
of integral-differential equations. This approach is based on the supplementary variable 
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method, which is always applied in dealing with stochastic models of M/G/l type, e.g., see 
Li and Zhao [13|, [T3] and Li [TO] . We organize an infinite-size system of integral-differential 
equations by means of the density dependent jump Markov process, and obtain a close- 
form solution: doubly exponential structure, for the fixed point satisfying the system of 
nonlinear equations, which is always a key in the study of supermarket models. Since 
the fixed point is decomposited into two groups of information under a product form, we 
indicate three important observations: 

1. the fixed point for the supermarket model is different from the tail of stationary 
queue length distribution for the ordinary M/G/l queue; 

2. the doubly exponential solution to the fixed point can exist extensively for < /z < 
+oo even if the service time distribution is heavy-tailed; and 

3. the doubly exponential solution to the fixed point is not unique for a more general 
supermarket model. 

Furthermore, we analyze the exponential convergence of the current location of the super- 
market model to its fixed point, and study the Lipschitz condition in the Kurtz Theorem 
under general service times. Finally, we present numerical examples to illustrate the ef- 
fectiveness of our approach in analyzing the randomized load balancing schemes with the 
non-exponential service requirements. Based on this analysis, one can gain a new and im- 
portant understanding how workload probing can help in load balancing jobs with general 
service times such as heavy-tailed service. 

The approach of this paper is useful in analyzing the randomized load balancing 
schemes in resource allocation in computer networks. We expect that this approach will 
be applicable to the study other randomized load balancing schemes with general service 
times, for example, generalizing the arrival process to non-Poisson: the renewal arrival 
process or the Markovian arrival process. 
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